Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Adding configurable file size to file data visualizer #62752

Conversation

jgowdyelastic
Copy link
Member

@jgowdyelastic jgowdyelastic commented Apr 7, 2020

Adds the ability to override the default file size limit of 100MB to a maximum of 500MB.
A new ML specific setting can be added to the kibana.yml file to achieve this.

xpack.ml.file_data_visualizer.max_file_size_bytes: <bytes>

image

500MB has been choses as the max as it is currently the largest size the browser (tested with chrome and firefox) can handle when reading the file's contents to a string.

It would be possible to avoid creating this string and to create the uploadable chunks of documents straight from the read byte array, but this work will need to be done in a follow up PR.

Checklist

Delete any items that are not applicable to this PR.

For maintainers

@elasticmachine
Copy link
Contributor

Pinging @elastic/ml-ui (:ml)

@jgowdyelastic
Copy link
Member Author

cc @droberts195

@jgowdyelastic
Copy link
Member Author

related to #61735

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Copy link
Contributor

@peteharverson peteharverson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

@alvarezmelissa87 alvarezmelissa87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ⚡️

@jgowdyelastic jgowdyelastic merged commit 6b52ce7 into elastic:master Apr 8, 2020
@jgowdyelastic jgowdyelastic deleted the add-configurable-file-size-to-file-data-visualizer branch April 8, 2020 14:10
jgowdyelastic added a commit to jgowdyelastic/kibana that referenced this pull request Apr 8, 2020
…2752)

* [ML] Adding configurable file size to file data visualizer

* updating translated strings
Copy link
Contributor

@walterra walterra left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, added just one question about the error message.

@@ -81,7 +80,7 @@ interface FileCouldNotBeReadProps {
}

export const FileCouldNotBeRead: FC<FileCouldNotBeReadProps> = ({ error, loaded }) => {
const message = error.body.message;
const message = error?.body?.message || '';
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we make use of getErrorMessage() from plugins/ml/common/util/errors.ts here?

jgowdyelastic added a commit that referenced this pull request Apr 8, 2020
…62947)

* [ML] Adding configurable file size to file data visualizer

* updating translated strings
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants